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STATISTICAL METHODOLOGY CONTENT ANALYSIS 
OF SELECTED EDUCATIONAL RESEARCH JOURNALS 

ABSTRACT 

A selection of sixty-seven educaticnal research journals were investigated 
to debennine the &eguency of usage of inferential statistical techniques 
therein. The most frequc tly used statistical methodologies in the 
literature reviewed, which utilized inferential approaches, are the 
following techniques: analysis of variance (ANOVA), correlation, t-test, 
mult^>le analysis of variance (MANOVA), multiple regression, chi square, 
post-hoc multiple comparisons, analysis of covaudance (ANCOVA), factor 
analysis, discriminant anedysis, log-linear analysis, and path analysis. 
For the research instructor concerned about discussing the currently 
applied methodologies in educationed research and statistics classes, 
these techniques merit consideration. While the list is certainly not 
definitive, the support of the related literature tends to encourage a 
focus on at least the first few methods in the list. 
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TABLE 



Statistical Techniques by Frequency and Percentages 



STATISTICAL METHODOLOGY CONTENT ANALYSIS 
OF SELECTED EDUCATIONAL RESEARCH JOURNALS 

Introduction 

Nuioerous statistical methodologies have been desrelqped for use as research 
tools in data analysis. So many approaches are avsdlable, in fact, that 
it has become virtually impossible to teach them all in a single 
statistics or research class. The lack of time for a comprehensive 
overview takes on even greater significance for the instructor of a 
research class for which there is no statistics prerequisite. The 
research instructor, then, must determine statistical procedures are 

most f^rcpriate for discussion in the small amount of time available for 
this purpose. 

Assuming that an appropriate goal of a research course is to help develop 
research consumers, then it would seem reasonable to conclude that the 
students should become familiar with the statistical methodologies most 
frequently utilized in the relevant literature. Frequency counts have 
been employed by researdiers for this purpose, among others, when 
analyzing professional journals and the articles appearing in them: 
Goodwin & Goodwin (1985), reviewed 449 articles published in the J ournal 
of Educational Psycholoov for major statistical statistical techniques. 
Wallace (1985) examined 3465 articles in 99 journals from library and 
informafcion scicnoe, social work, business, and educatim, to comp2a:e the 
use of statisti c al methods in these areas. Alpert t Yammer (1983) 



analyzed school consultation articles In 155 issues of school psychology 
literature. Willson (1980) categorized the research and statistical 
technlgues found in the American Educabjcnal Research Journal , according 
to discipline. Rabinovitz and Pruzek (1978) investigated factor 
analyticed nethods in eighty-nine studies in four educational and 
psychological journals. 

In designing the sbucty, a nuinber of questions arose^ including the number 
of jcuznals to investigate^ %Aiicfa jounuQs, number of issues or yeaurs of 
each, and whether to choose consecutive years, a sample, or blocks of 
time. AppeObaum (198^; analyzed articles in Psvcfaometrika a/er the period 
1960-1984 and found 173 papers of a statistical nature. Ash and 
Lcve-dark (198^ reviewed forty-eight educational psychology textbooks 
publicised from 1954 through 1983, randomly selected from those available 
in their campus library. Goodwin and Goodwin (1985) investigated the 
Journal of Educational Psydioloav over the five-year period 1979-1983. 
They drew a sbratif led random sanple of 150 of the 449 articles published 
during that period. Wallace (1985) examined statistical use in each 
article in each 1981 issue of ninety-nine journals listed in the Journal 
Citation Reoortrs section of the ? ?iences Citation Index , Alpert 

and Yammer (1983) analyzed 132 research artioleg in four research journals 
over a twelve-year period between 1970 and mid-1982 to determine the 
occurrence of resedoxh in school consultation. West, Carmody, & 
StaUings, (1983) analyzed empirical research articles in the Journal of 
Educational Resfe^rrfi in 1970 and 1980 to determine if there were any 
qualitative differences. Gaziano (1982) reviewed fifty-eight studies 
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related to knowledge gap %ritlKut tegard to publication dates. West and 
Robinson (1980) randonly selected seventy-eight empirical research 
ar «-ir-iP« froB the American Educational Research Journal . The Journal of 
Educaticna] ptayr^^ni^ngy^ and the Journal of Educaticaial Research from as 
early as 1910, through 1974. 

Rabinowitz and Pnizdc (197Q relieved eig^ity-nine studies in the same four 
journals as Glass and Taylor (1966) for the years 1975-1976. Glass and 
Taylor studied papers in the American Educational Research Journal 
(1965-llaich, 1966), the Journal of Educational Measurement (1964-1965), 
the Journal of Educational Psvcfadloav (1963-J^ril, 1966), and Educational 
and Psychological Measurement (1963-Spring, 1966). Edgington (1974) 
tahMlatfd the inferential statistical procedures used in seven American 
Psychological Associaticm journals published between 1948 to 1972. 

The Problem 

The problen of this study was to conduct a frequency count of the 
inferential statistical teciuiiques used in selected recent educational 
research journals. 

Methodology 



JcumalB were selected beised on their availability in the University of 
Central Arkansas Torr^scn Libraxy, sisilar to the 2^proach of using the 



Sbesdiiv} Evans library cn the Texas A & M University can^His tak^ by Ash 
and Love-Clark (1985). Basic measures of central tendency, including 
means and standard deviations, were excluded following the approach of 
West, Carmody, & Stallings (1983). Editorials, letters to the editor, 
news items, book lists, bibliographies, and book reviews were also 
excluded, similar to the approach of Wallace (1985). 

Hie journals %ihicfa fomed the database for the study were chosen from a 
list of researcii-ariented educationzd publications listed in a research 
text. Research in Educatiai (Best & Kahn, 1986, p. 367-8). The journals 
actually investigated were limited to those publications to which the 
libraxy subscribed which were not in the process of being bound and which 
were published between September, 1987, and March, 1988. January/F^ruary 
issues were cticsen rather than Marctv/i^iriL issues when the choice arose. 
Otherwise, the latest available issue was chosen. 

Of the 143 joumsQs listed, Torreyson Library held subscriptions to 
sixty-edght, of which cme joum£d. Pollution Abstracts , was considered 
inappropriate for the study because it is conprised of abstracts rather 
than oonplete articles. The first eapirical research article in the issue 
of each journal sel e c t ed for inclusion in the study was perused for the 
type of statistical methodology or methodoilogies utilized. Each technique 
was counted only one time per article even if it appeared more th2ui once. 
A list of the sixty-seven journals oonprislng the database appears in the 
appendix. 



Findings 



The frequency of ocrurrencc of each shttifrt-.ical technique is recorded in 
tabular form on page 6. The results are similar to the findings of 
related studies (Appelbaum, 1986; Goodwin & Goodwin, 1985; West, Carmody, 
& StaUings, 1983) in that the analysis of variance (ANOVA and MANOVA), 
oorxeLational, t-test, multiple regression, and dii square procedures are 
among the mosc frequently utilized statistical methods. 

The statistical techniques lifitjRi incUide vsudations. For example, ANOVA 
includes both one- and two-%fay analyses. Correlation includes Pearson's 
'*r" and Kendall's tau. The t-test includes directioned and nondirectional 
a^ioaches. The other techniques are similarly representative of the 
methods listed and the techniques closely related to them. 

Limitations 

The selection of journals is open to some question since not all 
educational rese€u:ch publicsrtdons were available for consideration. 
Howesrer, the wide selection of journals vAiich were available seems on face 
value to be reasonably representative. Reviewing all of the articles in 
each of the sixty-seven journal issues sehxted might have provided a more 
representative sample. 
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Table 1 

Statistical Tedinigaes by Ftequenc^ and Percentages 



Statistical 
Technique 


Frequency 


% of 67 

Jcximals 

Sampled 


% of 34 
Inferential 
Jcximals 


MKNh 


15 


22% 


44% 


Oorrelaticn 


7 


10% 


21% 


t-test 


7 


10% 


21% 




6 


9% 


18% 


Multiple 
Rogressicn 


6 


9% 


18% 


Chi Square 


5 


7% 


15% 


PC3St-HC3C 

Ocnpariscns 


5 


7% 


15% 


MKXJVA 


4 


6% 


12% 


Factor 
Ancilysis 


4 


6% 


12% 


Discriaiinant 
Ancilysis 


3 


4% 


9% 


Log^linear 
Ancilysis 


2 


3% 


6% 


Path 
Anedysis 


2 


3% 


6% 


Other 


2 


3% 


6% 


None 




6% 


12% 
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Conclusions 



From the results of this study, it appears that among the dozen most 
frequently used statistical methodologies in the educationad research 
literature which utilized inferential approaches are the following 
techniques: analysis of variance (ANOVA), correlation, t-test, multiple 
analysis of varLanoe (MANOVA), multiple regression, chi sgua *e, post-hoc 
multiple ocxnparisons, analysis of covariance (ANCOVA), factor anedysis, 
discriminant anedysis, log-linear emalysis, and path amalysis. For the 
research instructor concerned about discussing the currently applied 
methodologies in educational research and statistics classes, these 
techniques merit consideration. While the list is certainly not 
definitive, the support of the related literature tends to encourage a 
focus on at least the first few methods in the list. 
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Appendix 

Journals Investigated for Statistical Techniques 



Administrative Science Quarterly 
Adolescence 

Adult Education Quarterly 

American Behavioral Scientist 

American Biology Teacher 

American Educational Research Journal 

Arithmetic Teacher 

Black Scholar 

Business Education Forum 

Child and Youth Care Quarterly 

Child Development 

Child Study Journal 

Childhood Education 

Clearing House 

Community, Technical, and Junior College Journal 

Comparative Education 

Comparative Education Review 

Educational Administration Quarterly 

Educational Forum 

Educational Leadership 

Educational Researcher 

Educational Research Quarterly 

Educational Technology 

Elementary School Journal 

Harvard Educational Review 

High School Journal 

History of Education Quarterly 

Home Economics Research Journal 

International Journal of Aging and Human Development 

Journal for Research in Mathematics Education 

Journal for the Scientific Study of Religion 

Journal of Communication 

Journal of Creative Behavior 

Journal of Drug Education 

Journal of Educational Research 

Journal of Experimental Education 

Journal of Higher Education 

Journal of Home Economics 

Journal of Law and Education 

Journal of Leisure Research 

Journal of Negro Education 

Journal of Religion 

Journal of Research and Development in Education 
Journal of Research in Music Education 
Journal of Research in Science Teaching 
Kappa Delta Pi Record 

Library Resources and Technical Services 
Mathematics Teacher 
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Merrill Palmer Quarterly 

Modern Language Journal 

North Central Association Quarterly 

Outlook 

Peabody Journal of Education 

Phi Delta Kappan 

Phylon 

Public Opinion Quarterly 
Research in Higher Education 
Research in the Teaching of English 
Review of Educational Research 
School Science and Mathematics 
Science 

Science Education 
Science Teacher 
Social Education 
Teachers College Record 
Theory into Practice 
Young Children 
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